Apparatus and method for detecting falling object

ABSTRACT

Disclosed is a fallen object detection apparatus and method for controlling a component to continuously provide a service, provided by a communication device, when the communication device has fallen inside a vehicle. A fallen object detection apparatus inside a vehicle includes: a monitor configured to monitor an inside of the vehicle in which a passenger and an object are present: an identifier configured to identify that the object is a communication device capable of being connected to the component inside the vehicle in response to determination that the object is determined to have fallen on the basis of a monitoring result; and a processor configured to connect the object with the component and control the component to continuously provide a service, provided by the object, when the object is identified to be the communication device.

CROSS-REFERENCE TO RELATED APPLICATION

Pursuant to 35 U.S.C. § 119, this application claims the benefit ofearlier filing date and right of priority to Korean Patent ApplicationNo. 10-2019-0099772, filed on Aug. 14, 2019, the contents of which areall hereby incorporated by reference herein in its entirety.

BACKGROUND 1. Technical Field

The present disclosure relates to an apparatus and a method fordetecting a fallen object, wherein when a communication device capableof performing short-range wireless communication falls inside a vehicle,the apparatus connects the communication device with a component withinthe vehicle on the basis of the short-range wireless communication andcontrols the component to continuously provide a service that has beenprovided by the communication device.

2. Description of Related Art

Due to the development of communication, mobile phones are capable ofproviding various services, for example, voice calls and video calls,anytime and anywhere without any limitations on time and place.

For example, a driver can use a mobile phone in a vehicle that ismoving. However, when a driver drops a mobile phone while a vehicle isin motion, the driver cannot use services provided by the mobile phone.Accordingly, the driver may become disconcerted and lose focus ondriving, which may result in a dangerous situation.

Therefore, various cradles for fixing a mobile phone inside a vehicle toprevent the mobile phone from falling have been released for drivingconvenience and safety.

Korea Patent Application Publication No. 20-2012-0005732, entitled“Cellular phone supporter for vehicle,” discloses a mobile phone cradlefor a vehicle, the cradle, capable of holding a mobile phone regardlesssize, having an upward and downward movable support installed to supportthe upper portion of the mobile phone, and a pedestal capable of beingrepositioned to the left and right installed on both sides of the lowerportion of the cradle.

However, when a vehicle is driven at a high speed or driven on anunpaved road, a mobile phone may easily separate from a cradle and mayfall due to an increase in the movement of the vehicle.

Accordingly, a technology for continuously providing mobile phoneservices so as to allow a driver to focus on driving without becomingdisconcerted due to the mobile phone falling inside the vehicle.

RELATED ART DOCUMENT Patent Document

Related Art: Korean Patent Application Publication No. 20-2012-0005732

SUMMARY OF THE INVENTION

An aspect of an embodiment of the present disclosure is to provide anapparatus and a method for detecting a fallen object, the apparatus andthe method connecting a communication device with a component inside avehicle, for example, a speaker, a microphone, and an audio videonavigation (AVN) screen, and controlling the component to continuouslyprovide a service, which is provided by the communication device, whenthe communication device capable of performing short-range wirelesscommunication falls inside a vehicle. This allows a driver to focus ondriving without being disconcerted even though the driver drops thecommunication device by being provided continuous service from thecommunication device via the component inside the vehicle.

Another aspect of an embodiment of the present disclosure is to turn ona lamp inside the vehicle to illuminate a location to which the objecthas fallen while a passenger searches for the object when the inside ofthe vehicle is dark so as to quickly identify the location of the fallenobject and assist the passenger in finding the object easily.

Yet another aspect of an embodiment of the present disclosure is toprovide notification information of the fallen object via the componentor the lamp inside the vehicle when the passenger is not searching forthe object even though the vehicle stops, thereby preventing the fallenobject from being left in the vehicle.

In accordance with an aspect of the present disclosure, an apparatus fordetecting a fallen object inside a vehicle is provided. The apparatusincludes: a monitor configured to monitor an inside of the vehicle inwhich a passenger and an object are present; an identifier configuredto, in response to determination that the object has fallen inside thevehicle on the basis of a monitoring result, identify that the object isa communication device capable of being connected to a component insidethe vehicle; and a processor configured to, based on identification thatthe object is the communication device, connect the object with thecomponent and control the component to continuously provide a servicewhich is provided by the object.

The monitor may include: a capturer configured to generate an image bycapturing the inside of the vehicle according to a preset period; and atracker configured to track movement of the passenger and movement ofthe object based on that the passenger and the object are extracted fromthe image. The identifier may be configured to determine, on the basisof a tracking result, that the object has fallen in response that adistance between a hand of the passenger and the object is a presetdistance or longer, and the object falls downward by a preset distanceor longer.

The monitor may be configured to generate an image by capturing theinside of the vehicle according to a preset period. The processor may beconfigured to store the image in a database from a time point at whichthe object falls, and in response that the object moves to a blind spotbeyond a capturing range such that a location to which the object hasfallen cannot be identified in the image, provide the stored image viathe component to allow the passenger to see the object fall and move tothe blind spot.

In response that the object provides at least one service from among avoice call, a video call, or video playback, the processor may beconfigured to select a component required to provide the service fromamong components including at least one of a speaker, a microphone, oran audio video navigation (AVN) screen inside the vehicle and connectthe selected component with the object.

The identifier may be configured to identify that the object is thecommunication device in response that the object is a devicecorresponding to one of a smartphone, wireless earphones, a tabletpersonal computer (PC), or a notebook capable of performing short-rangewireless communication.

The apparatus may further include a communicator configured tocommunicate with the object and receive identification information ofthe object, wherein the processor is configured to receive theidentification information from the object via the communicator, and inresponse that the received identification information is found in apre-stored connected device list, connect the object with the component.

The identifier may be configured to further identify that the passengersearches for the object, and the processor may be configured to turn ona first lamp inside the vehicle to illuminate a location to which theobject has fallen in response that the passenger searches for the objectand a result value of an illumination sensor inside the vehicle issmaller than a preset value.

In case that the first lamp cannot illuminate the object due to movementof the passenger, the processor may be configured to turn off the firstlamp and turn on a second lamp capable of illuminating the object whileavoiding a path obscured by the passenger.

The monitor may include: the capturer configured to generate the imageby capturing the inside of the vehicle according to the preset period;and the tracker configured to track the movement of the passenger inresponse that the passenger is extracted from the image. The identifiermay be configured to determine that the passenger lowers his/her head onthe basis of the tracking result, and based on determination that thepassenger lowers his/her head, identify that the passenger is searchingfor the object.

Based on identification that the passenger is not searching for theobject, the processor may be configured to provide notificationinformation of the object via the component or the lamp inside thevehicle in response that driving of the vehicle is terminated.

Based on identification that a plurality of objects which have fallen atan interval shorter than a preset time difference are communicationdevices capable of being connected to the component inside the vehicle,the processor may be configured to select an object having a highpriority from among the plurality of objects on the basis of a presetcriterion and connect the selected object with the component.

In accordance with another aspect of the present disclosure, a methodfor detecting a fallen object inside a vehicle is provided. The methodincludes: monitoring an inside of the vehicle in which a passenger andan object are present; in response to determination that the object hasfallen inside the vehicle on the basis of a monitoring result,identifying that the object is a communication device capable of makinga short-range wireless communication connection with a component insidethe vehicle; and based on identification that the object is thecommunication device, connecting the object with the component andcontrolling the component to continuously provide a service which isprovided by the object.

The monitoring of the inside of the vehicle may include: generating animage by capturing the inside of the vehicle according to a presetperiod; and tracking movement of the passenger and movement of theobject based on that the passenger and the object are extracted from theimage. The identifying of that the object is the communication devicecapable of being connected to the component inside the vehicle mayinclude determining, on the basis of a tracking result, that the objecthas fallen in response that a distance between a hand of the passengerand the object is a preset distance or longer, and the object fallsdownward by a preset distance or longer.

The monitoring of the inside of the vehicle may include generating animage by capturing the inside of the vehicle according to a presetperiod, and the method for detecting the fallen object may include:storing the image in a database from a time point at which the objectfalls; and in response that the object moves to a blind spot beyond acapturing range such that a location to which the object has fallencannot be identified in the image, providing the stored image via thecomponent to allow the passenger to see the object fall and move to theblind spot.

The controlling of the component may include, in response that theobject provides at least one service from among a voice call, a videocall, or video playback, selecting a component required to provide theservice from among components including at least one of a speaker, amicrophone, or an audio video navigation (AVN) screen inside the vehicleand connecting the selected component with the object.

The controlling of the component may include receiving theidentification information from the object via the communicator, and inresponse that the received identification information is found in apre-stored connected device list, connecting the object with thecomponent.

The method may further include identifying that the passenger searchesfor the object and turning on a first lamp inside the vehicle and toilluminate a location to which the object has fallen in response thatthe passenger searches for the object and a result value of anillumination sensor inside the vehicle is smaller than a preset value.

In case that the first lamp cannot illuminate the object due to movementof the passenger, the method may further include turning off the firstlamp and turning on a second lamp capable of illuminating the objectwhile avoiding a path obscured by the passenger.

Based on identification that the passenger is not searching for theobject, the method may further include turning off the first lamp andturning on a second lamp capable of illuminating the object whileavoiding a path obscured by the passenger.

The controlling of the component may include, based on identificationthat a plurality of objects which have fallen at an interval shorterthan a preset time difference are communication devices capable ofmaking the short-range wireless communication connection with thecomponent inside the vehicle, selecting an object having a high priorityfrom among the plurality of objects, on the basis of a preset criterion,and connecting the selected object with the component.

In addition, another method and another system for implementing thepresent disclosure and a computer-readable recording medium having acomputer program stored therein to perform the method may be furtherprovided.

Other aspects and features as well as those described above will becomeclear from the accompanying drawings, the claims, and the detaileddescription of the present disclosure.

According to the present disclosure, when a communication device capableof performing short-range wireless communication falls inside a vehicle,the communication device is connected to a component inside the vehicle,for example, a speaker, a microphone, or an AVN screen, and thecomponent is controlled to continuously provide a service, which isprovided by the communication device, so that even though thecommunication device falls while a driver is driving, the service can becontinuously provided from the communication device via the componentinside the vehicle. Thus the driver can focus on driving without beingdisconcerted.

According to the present disclosure, when the inside of the vehicle isdark while the passenger is searching for the fallen object, it ispossible to turn on a lamp inside the vehicle to illuminate a locationto which the object has fallen so as to quickly identify the location ofthe fallen object and assist the passenger in finding the object easily.

According to the present disclosure, when the passenger is not searchingfor the fallen object even though the vehicle stops, it is possible toprevent the fallen object from being left in the vehicle by providingnotification information of the fallen object via the component or thelamp inside the vehicle.

Effects of the present disclosure are not limited to the abovedescription, and other effects, which have not been mentioned, can beclearly understood by those skilled in the art from the followingdescription.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram illustrating a fallen object detection deviceaccording to an embodiment of the present disclosure;

FIG. 2 illustrates a method by which a fallen object detection deviceconnects a fallen object with a component inside a vehicle according toan embodiment of the present disclosure;

FIGS. 3 to 5 illustrate examples in which a fallen object detectiondevice provides services via components inside a vehicle according to anembodiment of the present disclosure;

FIGS. 6A, 6B, and 6C illustrate an example in which a fallen objectdetection device guides a location to which an object has fallenaccording to an embodiment of the present disclosure;

FIGS. 7A and 7B illustrate another example in which a fallen objectdetection device guides a location to which an object has fallenaccording to an embodiment of the present disclosure;

FIG. 8 is a flowchart illustrating a fallen object detection methodaccording to an embodiment of the present disclosure; and

FIG. 9 is a flowchart illustrating a method by which a fallen objectdetection device guides a location to which an object has fallenaccording to an embodiment of the present disclosure.

DETAILED DESCRIPTION

The advantages and features of the present disclosure and ways toachieve them will be apparent by making reference to embodiments asdescribed below in detail in conjunction with the accompanying drawings.However, it should be construed that the present disclosure is notlimited to the embodiments disclosed below but may be implemented invarious different forms, and covers all the modifications, equivalents,and substitutions belonging to the spirit and technical scope of thepresent disclosure. The embodiments disclosed below are provided so thatthis disclosure will be thorough and complete and will fully convey thescope of the present disclosure to those skilled in the art. Further, inthe following description of the present disclosure, a detaileddescription of known technologies incorporated herein will be omittedwhen it may make the subject matter of the present disclosure ratherunclear.

The terms used in this application is for the purpose of describingparticular embodiments only and is not intended to limit the disclosure.As used herein, the singular forms are intended to include the pluralforms as well, unless the context clearly indicates otherwise. In thedescription, it should be understood that the terms “include” or “have”indicate existence of a feature, a number, a step, an operation, astructural element, parts, or a combination thereof, and do notpreviously exclude the existences or probability of addition of one ormore another features, numeral, steps, operations, structural elements,parts, or combinations thereof. Although the terms “ordinal numbers”such as first, second and the like are used to describe variousstructural elements, the structural elements should not be defined bythe terms. The terms are used merely for the purpose to distinguish anelement from the other elements.

Hereinafter, embodiments of the present disclosure will be described indetail with reference to the accompanying drawings, and in thedescription with reference to the accompanying drawings, the same orcorresponding components have the same reference numeral, and aduplicate description therefor will be omitted.

Vehicles described in this specification may include all vehicles suchas a motor vehicle having an engine as a power source, a hybrid vehiclehaving an engine and an electric motor as power sources, and an electricvehicle having an electric motor as a power source.

Further, vehicles described in this specification may be autonomousvehicles.

Autonomous driving is a self-driving technology, and an autonomousvehicle is a vehicle that moves without any manipulation by a user orwith minimum manipulation by a user. For example, autonomous driving mayinclude all of a technology for keeping a driving lane, a technology forautomatically controlling a speed such the an adaptive cruise control, atechnology for automatically driving a vehicle along a determined path,and a technology for, if a destination is set, automatically setting apath and driving a vehicle along the path.

Specifically, an autonomous vehicle may include an autonomous drivingcontrol module configured to control an autonomous driving function, andthe autonomous driving control module may be a software module or a chipobtained by implementing the software module in hardware. The autonomousdriving control module may be included in the autonomous vehicle as anelement thereof or may be configured as separate hardware outside theautonomous vehicle and connected thereto.

The autonomous vehicle may acquire state information of the autonomousvehicle on the basis of sensor information acquired from various typesof sensors, detect (recognize) a surrounding environment and object,produce map data, determine a movement path and a driving plan, ordetermine an operation.

The autonomous vehicle may use sensor information acquired by, forexample, at least one sensor from among a lidar, a radar, or a camera inorder to determine the movement path and the driving plan.

Particularly, the autonomous vehicle may recognize an environment or anobject in an area obscured from sight or an area away by a predetermineddistance or longer by receiving sensor information from external devicesor may receive directly recognized information from external devices.

The autonomous vehicle may perform the operations using a learning modelformed with one or more artificial neural networks. For example, theautonomous vehicle may recognize the surrounding environment and objectthrough the learning model and determine a traffic line of driving onthe basis of the recognized surrounding environment information orobject information. The learning model may be directly learned by theautonomous vehicle or learned by an external device such as an AIserver.

The autonomous vehicle may generate a result directly using the learningmodel and perform an operation, but may transmit sensor information tonan external device such as an AI server, receive a result generatedaccording thereto, and perform an operation.

The autonomous vehicle may determine a movement path and a driving planon the basis of at least one piece of map data, object informationdetected from sensor information, or object information acquired from anexternal device and move according to the determined movement path anddriving plan by controlling a driving unit.

The map data may include object identification information of variousobjects in a space (for example, on a road) in which the autonomousvehicle moves. For example, the map data may include objectidentification information of stationary objects such as a streetlamp, arock, and a building and moveable objects such as a vehicle and apedestrian. The object identification information may include a name, atype, a street, and a location.

The autonomous vehicle may perform an operation or move by controlling adriving unit on the basis of the control/interaction of the user. Theautonomous vehicle may acquire information on the intention of theinteraction according to a user's speech, determine a response on thebasis of the acquired intention information, and perform an operation.

FIG. 1 is a block diagram illustrating a fallen object detection deviceaccording to an embodiment of the present disclosure.

Referring to FIG. 1, a fallen object detection device 100 according toan embodiment of the present disclosure is a device configured to detecta fallen object inside a vehicle and may be installed inside thevehicle. The fallen object detection device 100 may include a monitor101, an identifier 104, a processor 105, a database 106, and a lamp 107.The fallen object detection device 100 may further include acommunicator (not shown).

The monitor 101 may monitor the inside of the vehicle in whichpassengers (for example, a driver and a fellow passenger) and objectsare present. The monitor 101 configured to monitor the inside of thevehicle may include a capturer 102 and a tracker 103.

The capturer 102 may be, for example, a camera, and may capture theinside of the vehicle according to a preset period (for example, 1second) to generate an image (for example, a 2D or 3D image).

When a passenger and an object are extracted from the image generated bythe capturer 102, the tracker 103 may track movement of the passenger(for example, upper body, a direction of the face, or a change incoordinates of arms) and movement of the object. The tracker 103 mayextract the passenger and the object from the image through a learningmodel (for example, an in-depth neural network) trained to recognize aperson and an object.

Thereafter, in response that the passenger is extracted, the tracker 103may track movement of the passenger by detecting a distance and adirection of movement of arms, legs, head, and face of the passengerfrom the image through a skeletonization algorithm. When the object isextracted, the tracker 103 may track movement of the object by detectinga movement distance and a direction of the object from the image throughan object detection algorithm.

When the object falls by a preset distance or longer on the basis of thetracking result, the identifier 104 may determine that the object hasfallen and identify a location to which the object has fallen. That is,when the object is removed or moves from, for example, a cradle, a seat,or a passenger's hand, and falls by a preset distance or longer, theidentifier 104 may determine that the object has fallen.

In the case in which the passenger holds the objects, when the distancebetween the passenger's hand and the object is a preset distance orlonger, and the object falls by a preset distance or longer on the basisof the tracking result, the identifier 104 may determine that the objecthas fallen. That is, the identifier 104 may determine that the objecthas fallen by further identifying that the object is removed from thepassenger's hand as well as the distance to the fallen object.Accordingly, if the distance between the passenger's hand and the objectis shorter than a preset distance, the identifier 104 may determine thatthe object has not fallen even though the object has fallen by thepreset distance or longer inside the vehicle. That is, the identifier104 may recognize that the passenger moves his/her hand down whileholding the object and thus determine that the object has not fallen.

In response to determination that the object has fallen inside thevehicle on the basis of the monitoring result, the identifier 104 mayidentify that the object is a communication device capable of beingconnected to a component inside the vehicle. In response that the objectis a device corresponding to one of a smartphone, wireless earphones, atablet personal computer (PC), or a notebook capable of performingshort-range communication (for example, Bluetooth or Wi-Fi), theidentifier 104 may identify that the object is the communication device.

The identifier 104 may further identify that the passenger searches forthe object. The identifier 104 may determine that the passenger lowershis/her head on the basis of the tracking result of the movement of thepassenger by the tracker 103 of the monitor 101, and based ondetermination that the passenger lowers his/her head, may identify thatthe passenger is searching for the object. The identifier 104 maydetermine that the passenger lowers his/her head on the basis of, forexample, a degree of movement of the face (or head) of the passenger ora movement direction.

Meanwhile, when the distance between the passenger's hand and the fallenobject is shorter than a preset distance, and the fallen object rises bya preset distance or higher on the basis of the tracking result of thetracker 103 within the monitor 101, the identifier 104 may determinethat the passenger has recovered the fallen object.

When the object is identified as the communicator, the processor 105 mayconnect the object with the component. The processor 105 may firstidentify the service provided by the object, select a component requiredto provide the service from among the component inside the vehicle, andconnect the selected component with the object. The components insidethe vehicle may include at least one of a speaker, a microphone, or anaudio video navigation (AVN) screen.

When the object is connected to the component, the processor 105 mayfirst make a request for activation of short-range wirelesscommunication and identification information of the object to the objectvia the communicator. The object receiving the request may activateshort-range wireless communication in response to the request andtransmit identification information of the object to the fallen objectdetection device 100.

When the processor communicates with the object via the communicator andreceives identification information of the object from the object, theprocessor 105 may make a request for the short-range wirelesscommunication connection with the object to the component inside thevehicle via the communicator. When making a request for the short-rangewireless communication connection with the object, the processor 105 maytransmit identification information of the object to the component andallow the component to have the short-range wireless communicationconnection with the object.

As a result, when the communication device capable of being connectedwith the component inside the vehicle falls, the processor 105 mayconnect the communication device with the component inside the vehicleregardless of that a connected device list has been registered.

In another example of the connection between the object and thecomponent, when identification information received from the object isfound in the connected device list pre-stored in the database 106, theprocessor 105 may connect the object with the component throughshort-range wireless communication and thus connect only thecommunication device re-registered in the connected device list with thecomponent inside the vehicle.

Thereafter, when the object is connected to the component, the processor105 may control the component to continuously provide the service whichis provided by the object. The service provided by the object may be anyservice supported by the communication device and may include, forexample, at least one of a voice call, a video call, video playback, agame, or chatting.

For example, when the fallen object inside the vehicle is a smartphonecapable of being connected with the component inside the vehicle and aservice provided by the smartphone is a “voice call,” the processor 105may connect the smartphone with a speaker and a microphone inside thevehicle and continuously provide the “voice call” through the speakerand the microphone inside the vehicle, thereby maintaining the voicecall without disconnection even though the smartphone has fallen. Whenthe service provided by the smartphone is a “video call,” the processor105 may connect the smartphone with all of a speaker, a microphone, andan AVN screen inside the vehicle and continuously provide the “videocall” through the speaker, the microphone, and the AVN screen inside thevehicle.

When the service provided by the smartphone is “video playback,” theprocessor 105 may connect the smartphone with a microphone and an AVNscreen inside the vehicle and continuously provide the “video playback”through the microphone and the AVN screen inside the vehicle.

Based on identification that a plurality of objects which have fallenwithin a preset time (for example, 3 seconds) are communication devicescapable of being connected to the component inside the vehicle, theprocessor 105 may select an object having a high priority on the basisof a preset criterion (for example, a predetermined order according tothe type of a communication device or an order in the connected devicelist) from among the plurality of objects and connect the selectedobject with the component inside the vehicle.

When a plurality of objects, for example, a smartphone and a tablet PC,which are capable of being connected to the component inside thevehicle, fall at an interval of 2 seconds, the processor 105 may selectthe smartphone having a higher priority from among the plurality ofobjects and connect the selected smartphone with the component insidethe vehicle. When a plurality of objects, for example, a firstsmartphone (a driver's phone) and a second smartphone (a fellowpassenger's phone), which are capable of being connected to thecomponent inside the vehicle, fall at an interval of 2 seconds, theprocessor 105 may select the first smartphone located at a relativelyhigher position in the connected device list from among the plurality ofobjects and connect the selected smartphone with the component insidethe vehicle.

When the plurality of objects are connected to each other throughshort-range wireless communication, the processor 105 may connect all ofthe plurality of objects with the component inside the vehicle. Theplurality of objects may be a main object (for example, a smartphone),which accesses, for example, a mobile communication network or anInternet communication network and provides a service, and an auxiliaryobject (for example, wireless earphones) connected to the main object.

Meanwhile, when the passenger attempts to pick up the fallen objectwhile the object is not shown, the processor 105 may illuminate theobject with the lamp 107.

Specifically, based on identification that the passenger is searchingfor the object and based on determination that the inside of the vehicleis dark by an illumination sensor (not shown) inside the vehicle (forexample, when a result value of the illumination sensor is smaller thana preset value), the processor 105 may turn on a first lamp inside thevehicle to illuminate the location to which the object has fallen. Incase that the first lamp cannot illuminate the object due to movement ofthe passenger, the processor 105 may turn off the first lamp and turn ona second lamp capable of illuminating the object while avoiding a pathobscured by the passenger.

Based on identification that the passenger has recovered the fallenobject by the identifier 104, the processor 105 may turn off theturned-on lamp. When the recovered object is a communication deviceconnected to the component inside the vehicle, the processor 105 maycontrol the object to continuously provide the service, which isprovided by the component, and disconnect the object and the component.That is, the processor 105 may return to the state in which thepassenger had been receiving the service through the object before theobject fell.

Based on identification that the passenger is not searching for theobject, the processor 105 may provide notification information of theobject via the component inside the vehicle or the lamp inside thevehicle at the moment the vehicle stops to inform the passenger of thepresence of the fallen object, thereby reminding the passenger about theobject and assisting the passenger in finding the object even though thepassenger does not immediately recover the object.

Meanwhile, based on determination that the object has fallen, theprocessor 105 may store, in the database 106, an image captured by themonitor 101 from a time point at which the object falls. When thepassenger searches for the fallen object or when notificationinformation of the object is provided according to termination ofdriving of the vehicle, the processor 105 may provide the image.

That is, in response that the object moves to a blind spot beyond acapturing range and cannot be tracked such that the identifier 104cannot identify the location to which the object has fallen in theimage, the processor 105 may provide the stored image via the componentinside the vehicle and allow the passenger to see the object fall andmove to the blind spot.

The database 106 may store the connected device list in whichcommunication devices are pre-registered in order to allow theconnection with the component inside the vehicle. Further, the database106 may store an image obtained by capturing the inside of the vehiclefrom a time point at which the object falls.

The lamp 107 may include a plurality of lamps. The plurality of lampsmay be installed inside the vehicle to provide illumination in differentdirections while being spaced apart from each other, and power of theplurality of lamps may be controlled by the processor 105.

FIG. 2 illustrates a method by which the fallen object detection deviceconnects a fallen object with a component inside the vehicle accordingto an embodiment of the present disclosure.

Referring to FIG. 2, based on identification that the fallen objectinside the vehicle is a communicator capable of making the short-rangewireless communication connection with a component inside the vehicle(for example, a speaker, a microphone, and an AVN screen), the fallenobject detection device may connect the object with the component insidethe vehicle.

For example, based on identification that the fallen object inside thevehicle is a smartphone 202 capable of making the short-rangecommunication (for example, Bluetooth) connection with a component 201inside the vehicle, a fallen object detection device 200 may make arequest for identification information to the smartphone 202 (203). Thefallen object detection device 200 may receive identificationinformation (for example, G6) of the smartphone 202 from the smartphone202 in response to the request(204), and when the identificationinformation of the smartphone 202 is found in a pre-stored connecteddevice list 205, may make a request for activating short-range wirelesscommunication to the smartphone 202 (206). The smartphone 202 receivingthe request may activate short-range wireless communication.

Thereafter, the fallen object detection device 200 may transmit theidentification information of the smartphone 202 to the component 201while making a request for the short-range wireless communicationconnection with the smartphone 202 to the component 201 inside thevehicle (207). The component 201 receiving the request may make arequest for the short-range wireless communication connection to thesmartphone 202 on the basis of the identification information of thesmartphone 202 received from the fallen object detection device 200(208) and receive a connection response from the object (209) so as tocomplete the short-range wireless communication connection.

Thereafter, the fallen object detection device 200 may control thesmartphone 202 to continuously provide the service, via the component201.

Hereinafter, an example in which the fallen object detection deviceprovides the service via the component inside the vehicle according toan embodiment of the present disclosure will be described with referenceto FIGS. 3 to 5. FIGS. 3 to 5 illustrate examples in which the fallenobject detection device provides a voice call service, a video callservice, and a video playback service through components inside thevehicle according to an embodiment of the present disclosure.

When the fallen object inside the vehicle is a communication devicecapable of making the short-range wireless communication connection withthe component inside the vehicle, the fallen object detection deviceaccording to an embodiment of the present disclosure may connect theobject with the component and control the component to continuouslyprovide the service provided by the object.

When a smartphone 301 capable of performing a Bluetooth connection withthe component inside the vehicle falls as illustrated in FIG. 3, thefallen object detection device may identify that there is a serviceprovided by the smartphone 301. When the service provided by thesmartphone 301 is a “voice call,” the fallen object detection device mayconnect the smartphone 301 with a speaker and a microphone inside thevehicle. The fallen object detection device may connect the smartphone301 with the speaker inside the vehicle via Bluetooth and connect thesmartphone with the microphone inside the vehicle so as to replace the aspeaker of the smartphone 301 with the speaker inside the vehicle andreplace a microphone of the smartphone 301 with the microphone insidethe vehicle.

Accordingly, the fallen object detection device may continuously providethe “voice call” through the speaker and the microphone inside thevehicle, so that the voice call may still be connected withoutdisconnection even though the smartphone 301 has fallen.

When a smartphone 401 capable of making a Wi-Fi connection with thecomponent inside the vehicle falls as illustrated in FIG. 4, the fallenobject detection device may identify that there is a service provided bythe smartphone 401. When the service provided by the smartphone 401 is a“video call,” the fallen object detection device may connect thesmartphone 401 with a speaker, a microphone, a camera, and an AVN screeninside the vehicle. The fallen object detection device may connect thesmartphone 401 with the speaker inside the vehicle and connect thesmartphone 401 with the microphone inside the vehicle so as to replace aspeaker of the smartphone 401 with the speaker inside the vehicle andreplace a microphone of the smartphone 401 with the microphone insidethe vehicle. The fallen object detection device may connect thesmartphone 401 with a camera inside the vehicle and connect thesmartphone 401 with an AVN screen 402 inside the vehicle via Wi-Fi so asto replace camera of the smartphone 401 with the camera inside thevehicle and replace a display screen of the smartphone 401 with the AVNscreen inside the vehicle. The camera inside the vehicle connected tothe smartphone 401 may be a camera embedded into the vehicle or a camerafor monitoring in the fallen object detection device.

Accordingly, the fallen object detection device may continuously providethe “video call” through the speaker, the microphone, the camera, andthe AVN screen 402 inside the vehicle, so that the video call may bestill connected without disconnection even though the smartphone hasfallen.

When a smartphone 501 capable of making a Wi-Fi connection with thecomponent inside the vehicle falls as illustrated in FIG. 5, the fallenobject detection device may identify that there is a service provided bythe smartphone 501. When the service provided by the smartphone 501 is“video playback,” the fallen object detection device may connect thesmartphone 501 with a speaker and an AVN screen 502 inside the vehicle.The fallen object detection device may connect the smartphone 501 with aspeaker inside the vehicle and connect the smartphone 501 with the AVNscreen 502 inside the via Wi-Fi so as to replace a speaker of thesmartphone 501 with the speaker inside the vehicle and replace a displayscreen of the smartphone 501 with the AVN screen inside the vehicle.

Accordingly, the fallen object detection device may continuously provide“video playback” via the speaker and the AVN screen 502 inside thevehicle, so that video playback may be still connected withoutdisconnection even though the smartphone 501 has fallen.

FIGS. 6A to 6C illustrate an example in which the fallen objectdetection device guides a location to which the object has fallenaccording to an embodiment of the present disclosure.

Referring to FIGS. 6A to 6C, when the object falls inside the vehicleand the inside is dark (for example, when a result value of theillumination sensor inside the vehicle is smaller than a preset value),and the passenger searches for the fallen object, the fallen objectdetection device may illuminate the location to which the object hasfallen and assist the passenger in easily finding the object.

For example, when the passenger searches for a “hat” 601 which hasfallen inside the vehicle, the fallen object detection device may turnon a first lamp 602 installed inside the vehicle to illuminate thelocation to which the “hat” 601 has fallen, so that the passenger canrecognize the location of the fallen “hat” 601.

When the first lamp 602 cannot illuminate the “hat” 601 due to movementof the passenger, the fallen object detection device may turn off thefirst lamp 602 and turn on a second lamp 603 installed on a lowerportion inside the vehicle to illuminate the “hat” 601 while avoiding apath obscured by the passenger.

Thereafter, based on determination that the passenger recovers the “hat”601, the fallen object detection device may turn off the second lamp603.

As a result, the fallen object detection device allows the lamp toilluminate the fallen object but controls the lamp to illuminate indifferent directions on the basis of movement of the passenger, therebyassisting the passenger in finding the fallen object inside the vehicle.

FIGS. 7A and 7B illustrate another example in which the fallen objectdetection device guides a location to which an object has fallenaccording to an embodiment of the present disclosure.

Referring to FIGS. 7A and 7B, based on determination that the objectfalls inside the vehicle, the fallen object detection device may storean image obtained by periodically capturing the inside of the vehicle inthe database from a time point at which the object falls.

Thereafter, in response that the passenger searches for the object orwhen notification information of the object is provided according totermination of driving of the vehicle, when the location to which theobject has fallen cannot be identified in the image because the objectmoves to a blind spot beyond a capturing range, the fallen objectdetection device may provide the image stored in the database via an AVNscreen inside the vehicle.

For example, when the passenger drops a “hat” 701 or the “hat” 701 fallsfrom a seat inside the vehicle such that the fallen object detectiondevice determines that the “hat” 701 has fallen, the fallen objectdetection device may store an image, obtained by periodically capturingthe inside of the vehicle, in the database from a time point at whichthe “hat” 701 falls.

Thereafter, when the passenger searches for the “hat” 701 ornotification information of the fallen “hat” 701 is provided accordingto termination of driving of the vehicle, if the location to which the“hat” 701 has fallen cannot be identified in the image because the “hat”701 has moved to a blind spot beyond a capturing range 703 of a camera702, the fallen object detection device may provide the image stored inthe database via an AVN screen 704 inside the vehicle and allow thepassenger to see the “hat” 701 fall and move to the blind spot beyondthe capturing range 703.

FIG. 8 is a flowchart illustrating a fallen object detection methodaccording to an embodiment of the present disclosure. The fallen objectdetection method is a method for detecting a fallen object inside avehicle.

Referring to FIG. 8, the fallen object detection device may monitor theinside of the vehicle in which there is a passenger and an object(S801). Specifically, the fallen object detection device may generate animage by capturing the inside of the vehicle according to a presetperiod, and may track movement of the passenger and movement of theobject based on that the passenger and the object are extracted from theimage. The fallen object detection device may extract the passenger andthe object from the image through a learning model trained to recognizepersons and objects.

Thereafter, in response that the passenger is extracted, the fallenobject detection device may detect distance and direction of movement ofthe passenger's arms, legs, head, and face from the image through askeletonization algorithm and track the movement of the passenger. Whenthe object is extracted, the fallen object detection device may detect adistance and direction of movement from the image through an objectdetection algorithm and track the movement of the object.

When the object falls by a preset distance or longer on the basis of thetracking result, the fallen object detection device may determine thatthe object has fallen. That is, when the object is removed or movesfrom, for example, a cradle, a seat, or a passenger's hand, and falls bya preset distance or longer, the fallen object detection device maydetermine that the object has fallen.

When removal of the object from the passenger's hand is identified, whena distance between the passenger's hand and the object is a presetdistance or longer and the object falls by a preset distance or longeron the basis of the tracking result, the fallen object detection devicedetermines that the object has fallen. That is, the fallen objectdetection device may determine that the object has fallen by furtheridentifying that the object is removed from the passenger's hand inaddition to the falling distance of the object. Accordingly, if thedistance between the passenger's hand and the object is shorter than apreset distance, the identifier 104 may determine that the object hasnot fallen even though the object has fallen by the preset distance orlonger inside the vehicle. That is, the fallen object detection devicemay determine that the object has not fallen by recognizing that thepassenger lowers his/her hand while holding the object.

Based on determination that the object falls, the fallen objectdetection device may store an image, obtained by capturing the inside ofthe vehicle, in the database from a time point at which the objectfalls.

In response to determination that the object has fallen inside thevehicle on the basis of the monitoring result (S802), the fallen objectdetection device may identify that the object is a communication devicecapable of making the short-range wireless communication (for example,Bluetooth or Wi-Fi) connection with the component inside the vehicle.The communication device may include a device corresponding to one of asmartphone, wireless earphones, a tablet PC, or a notebook.

Based on identification that the object is the communication device(S803), the fallen object detection device may identify that the objectprovides a service. The service may be any service supported by thecommunication device and include, for example, at least one of a voicecall, a video call, video playback, a game, or chatting.

Based on identification that the object provides a service (S804), thefallen object detection device may connect the object with a componentinside the vehicle, for example, a speaker, a microphone, and an AVNscreen.

The fallen object detection device may select a component required toprovide the service from among the components inside the vehicle andconnect the object with the selected component. For example, when thefallen object inside the vehicle is a smartphone capable of beingconnected to the component inside the vehicle and a service provided bythe smartphone is a “voice call,” the fallen object detection device mayselect the speaker and the microphone from among the components insidethe vehicle and connect the smartphone with the selected components.When the service provided by the smartphone is a “video call,” thefallen object detection device may select all of the speaker, themicrophone, and the AVN screen inside the vehicle and connect thesmartphone with the selected components. When the service provided bythe smartphone is “video playback,” the fallen object detection devicemay select the microphone and the AVN screen from among the componentsinside the vehicle and connect the smartphone with the selectedcomponents.

When the object is connected with the component, the fallen objectdetection device may make a request for identification information tothe fallen object and receive the identification information from theobject. In response that the received identification information isfound in a connected device list pre-stored in the database, the fallenobject detection device may connect the object with the component viashort-range wireless communication and thus only connect communicationdevices pre-registered in the connected device list with the componentinside the vehicle.

Based on identification that a plurality of objects which has fallen ata time interval shorter than a preset time difference (for example, 3seconds) are communication devices capable of being connected with thecomponent inside the vehicle, the fallen object detection device mayselect an object having a high priority on the basis of a presetcriterion (for example, an order determined by the type of communicationdevices or an order in the connected device list) from among theplurality of objects and connect the selected object with the componentinside the vehicle.

When a plurality of objects, for example, a smartphone and a tablet PC,which are capable of being connected to the component inside thevehicle, fall at an interval of 2 seconds, the fallen object detectiondevice may select the smartphone having a higher priority from among theplurality of objects and connect the selected smartphone with thecomponent inside the vehicle. When a plurality of objects, for example,a first smartphone (a driver's phone) and a second smartphone (a fellowpassenger's phone) capable of being connected to the component insidethe vehicle fall at an interval of 2 seconds, the fallen objectdetection device may select the first smartphone located at a relativelyhigher position in the connected device list from among the plurality ofobjects and connect the selected smartphone with the component insidethe vehicle.

When the object is connected to the component, the fallen objectdetection device may control the component inside the vehicle tocontinuously provide the service which is provided by the object (S805).

Thereafter, the fallen object detection device may identify that thepassenger searches for the object. The fallen object detection devicemay track movement of the passenger in an image obtained by capturingthe inside of the vehicle and determine that the passenger lowershis/her head on the basis of the tracking result of the movement of thepassenger. Based on determination that the passenger lowers his/herhead, the fallen object detection device may identify that the passengeris searching for the object.

Based on identification that the passenger is searching for the object(S806) and based on determination that the inside of the vehicle is darkby an illumination sensor inside the vehicle (that is, when a resultvalue of the illumination sensor inside the vehicle is smaller than apreset value), the fallen object detection device may control a lampinside the vehicle to illuminate the fallen object and guide thepassenger to the location at which the object has fallen (S807). Amethod for guiding the location to which the object has fallen with thelamp inside the vehicle will be described below with reference to FIG.9.

Based on identification that the passenger is not searching for theobject (S806), the fallen object detection device may determine thatdriving of the vehicle is terminated.

Based on identification that driving of the vehicle is terminated(S808), the fallen object detection device may provide notificationinformation of the object via the component inside the vehicle or thelamp inside the vehicle (S809).

In response that the object moves to a blind spot beyond a capturingrange and cannot be tracked such that the location to which the objecthas fallen cannot be identified in a periodically captured image, thefallen object detection device may provide an image stored in thedatabase via the component inside the vehicle and allow the passenger tosee the object fall and move to the blind spot (S807 or S809).

Based on identification that driving of the vehicle is not terminated(S808), the fallen object detection device may proceed (S806).

FIG. 9 is a flowchart illustrating a method by which the fallen objectdetection device guides a location to which an object has fallenaccording to an embodiment of the present disclosure.

Referring to FIG. 9, the fallen object detection device may turn on afirst lamp inside the vehicle (for example, a lamp installed an upperportion inside the vehicle) to illuminate the location to which theobject has fallen (S901). That is, based on identification that thepassenger is searching for the fallen object inside the vehicle, thefallen object detection device may illuminate the location to which theobject has fallen and guide the passenger to the location to which theobject has fallen, so that the passenger can be assisted in finding theobject.

When the passenger moves to recover the object, the fallen objectdetection device may identify that the first lamp continuouslyilluminates the object.

When the first lamp does not illuminate the object due to movement ofthe passenger (S902), the fallen object detection device may turn offthe first lamp and turn on a second lamp (for example, a light installedon a lower portion inside the vehicle) to illuminate the object whileavoiding a path obscured by the passenger (S903). That is, when thelight of the first lamp, which has illuminated the object, is obscuredby movement of the passenger, the fallen object detection device mayilluminate a different direction with the second lamp from that of thelight of the first lamp.

The fallen object detection device may further identify that the lampinside the vehicle directly shines a light into a passenger's eyes, andwhen the lamp directly shines a light into the passenger's eyes on thebasis of the identification result, turn off the corresponding lamp andturn on another lamp.

Thereafter, the fallen object detection device may determine that thepassenger recovers the object. When the distance between the passenger'shand and the fallen object is shorter than a preset distance in theimage obtained by periodically capturing the inside of the vehicle, andthe fallen object rises by a preset distance or higher, the fallenobject detection device may determine that the passenger has recoveredthe object.

Based on determination that the passenger has recovered the object(S904), the fallen object detection device may turn off the illuminatinglamp (S905).

As a result, the fallen object detection device may control each of theplurality of lamps to sequentially illuminate an optimal direction,thereby assisting the passenger in finding the fallen object inside thevehicle.

The example embodiments described above may be implemented throughcomputer programs executable through various components on a computer,and such computer programs may be recorded in computer-readable media.Examples of the computer-readable media include, but are not limited to:magnetic media such as hard disks, floppy disks, and magnetic tape;optical media such as CD-ROM disks and DVD-ROM disks; magneto-opticalmedia such as floptical disks; and hardware devices that are speciallyconfigured to store and execute program codes, such as ROM, RAM, andflash memory devices.

The computer programs may be those specially designed and constructedfor the purposes of the present disclosure or they may be of the kindwell known and available to those skilled in the computer software arts.Examples of program code include both machine code, such as produced bya compiler, and higher level code that may be executed by the computerusing an interpreter.

As used in the present application (especially in the appended claims),the terms “a/an” and “the” include both singular and plural references,unless the context clearly states otherwise. Also, it should beunderstood that any numerical range recited herein is intended toinclude all sub-ranges subsumed therein (unless expressly indicatedotherwise) and therefore, the disclosed numeral ranges include everyindividual value between the minimum and maximum values of the numeralranges.

Also, the order of individual steps in process claims of the presentdisclosure does not imply that the steps must be performed in thisorder; rather, the steps may be performed in any suitable order, unlessexpressly indicated otherwise. In other words, the present disclosure isnot necessarily limited to the order in which the individual steps arerecited. All examples described herein or the terms indicative thereof(“for example”, etc.) used herein are merely to describe the presentdisclosure in greater detail. Therefore, it should be understood thatthe scope of the present disclosure is not limited to the exampleembodiments described above or by the use of such terms unless limitedby the appended claims. Also, it should be apparent to those skilled inthe art that various alterations, substitutions, and modifications maybe made within the scope of the appended claims or equivalents thereof.It should be apparent to those skilled in the art that varioussubstitutions, changes and modifications which are not exemplifiedherein but are still within the spirit and scope of the presentdisclosure may be made.

The present disclosure is thus not limited to the example embodimentsdescribed above, and rather intended to include the following appendedclaims, and all modifications, equivalents, and alternatives fallingwithin the spirit and scope of the following claims.

What is claimed is:
 1. An apparatus for detecting a fallen object insidea vehicle; the apparatus comprising: a monitor configured to monitor aninside of the vehicle in which a passenger and an object are present; anidentifier configured to, in response to determination that the objecthas fallen inside the vehicle based on a monitoring result, identifythat the object is a communication device capable of being connected toa component inside the vehicle; and a processor configured to, based onidentification that the object is the communication device, connect theobject with the component and control the component to continuouslyprovide a service which is provided by the object.
 2. The apparatus ofclaim 1, wherein the monitor comprises: a capturer configured togenerate an image by capturing the inside of the vehicle according to apreset period; and a tracker configured to track movement of thepassenger and movement of the object based on the passenger and theobject extracted from the image, and wherein the identifier isconfigured to determine, based on a tracking result, that the object hasfallen in response that a distance between a hand of the passenger andthe object is a preset distance or longer, and the object falls downwardby a preset distance or longer.
 3. The apparatus of claim 1, wherein themonitor is configured to generate an image by capturing the inside ofthe vehicle according to a preset period, and wherein the processor isconfigured to store the image in a database from a time point at whichthe object falls, and in response that the object moves to a blind spotbeyond a capturing range such that a location to which the object hasfallen cannot be identified in the image, provide the stored image viathe component to allow the passenger to see the object fall and move tothe blind spot.
 4. The apparatus of claim 1, wherein, in response thatthe object provides at least one service from among a voice call, avideo call, or video playback, the processor is configured to select acomponent required to provide the service from among componentsincluding at least one of a speaker, a microphone, or an audio videonavigation (AVN) screen inside the vehicle and connect the selectedcomponent with the object.
 5. The apparatus of claim 1, wherein theidentifier is configured to identify that the object is thecommunication device in response that the object is a devicecorresponding to one of a smartphone, wireless earphones, a tabletpersonal computer (PC), or a notebook capable of performing short-rangewireless communication.
 6. The apparatus of claim 1, further comprisinga communicator configured to communicate with the object and receiveidentification information of the object, wherein the processor isconfigured to receive the identification information from the object viathe communicator, and in response that the received identificationinformation is found in a pre-stored connected device list, connect theobject with the component.
 7. The apparatus of claim 1, wherein theidentifier is configured to further identify that the passenger searchesfor the object, and wherein the processor is configured to turn on afirst lamp inside the vehicle to illuminate a location to which theobject has fallen in response that the passenger searches for the objectand a result value of an illumination sensor inside the vehicle issmaller than a preset value.
 8. The apparatus of claim 7, wherein, incase that the first lamp cannot illuminate the object due to themovement of the passenger, the processor is configured to turn off thefirst lamp and turn on a second lamp capable of illuminating the objectwhile avoiding a path obscured by the passenger.
 9. The apparatus ofclaim 1, wherein the monitor comprises: the capturer configured togenerate the image by capturing the inside of the vehicle according tothe preset period; and the tracker configured to track the movement ofthe passenger in response that the passenger is extracted from theimage, and wherein the identifier is configured to determine that thepassenger lowers his/her head, based on the tracking result, and basedon determination that the passenger lowers his/her head, identify thatthe passenger is searching for the object.
 10. The apparatus of claim 7,wherein, based on identification that the passenger is not searching forthe object, the processor is configured to provide notificationinformation of the object via the component or the lamp inside thevehicle in response that driving of the vehicle is terminated.
 11. Theapparatus of claim 1, wherein, based on identification that a pluralityof objects which have fallen at an interval shorter than a preset timedifference are communication devices capable of being connected to thecomponent inside the vehicle, the processor is configured to select anobject having a high priority from among the plurality of objects, basedon a preset criterion, and connect the selected object with thecomponent.
 12. A method for detecting a falling object inside a vehicle,the method comprising: monitoring an inside of the vehicle in which apassenger and an object are present; in response to determination thatthe object has fallen inside the vehicle based on a monitoring result,identifying that the object is a communication device capable of makinga short-range wireless communication connection with a component insidethe vehicle; and based on identification that the object is thecommunication device, connecting the object with the component andcontrolling the component to continuously provide a service which isprovided by the object.
 13. The method of claim 12, wherein themonitoring of the inside of the vehicle comprises: generating an imageby capturing the inside of the vehicle according to a preset period; andtracking movement of the passenger and movement of the object based onthat the passenger and the object are extracted from the image, andwherein the identifying of that the object is the communication devicecapable of being connected to the component inside the vehicle comprisesdetermining, based on a tracking result, that the object has fallenbased on that a distance between a hand of the passenger and the objectis a preset distance or longer, and the object falls downward by apreset distance or longer.
 14. The method of claim 12, wherein themonitoring of the inside of the vehicle comprises generating an image bycapturing the inside of the vehicle according to a preset period, themethod further comprising: storing the image in a database from a timepoint at which the object falls; and in response that the object movesto a blind spot beyond a capturing range such that a location to whichthe object has fallen cannot be identified in the image, providing thestored image via the component to allow the passenger to see the objectfall and move to the blind spot.
 15. The method of claim 12, wherein thecontrolling of the component comprises, in response that the objectprovides at least one service from among a voice call, a video call, orvideo playback, selecting a component required to provide the servicefrom among components including at least one of a speaker, a microphone,or an audio video navigation (AVN) screen inside the vehicle andconnecting the selected component with the object.
 16. The method ofclaim 12, wherein the controlling of the component comprises receivingidentification information from the object via a communicator, and inresponse that the received identification information is found in apre-stored connected device list, connecting the object with thecomponent.
 17. The method of claim 12, further comprising: identifyingthat the passenger searches for the object; and turning on a first lampinside the vehicle to illuminate a location to which the object hasfallen based on identification that the passenger searches for theobject and a result value of an illumination sensor inside the vehicleis smaller than a preset value.
 18. The method of claim 17, furthercomprising, in case that the first lamp cannot illuminate the object dueto the movement of the passenger, turning off the first lamp and turningon a second lamp capable of illuminating the object while avoiding apath obscured by the passenger.
 19. The method of claim 17, furthercomprising, based on identification that the passenger is not searchingfor the object, providing notification information of the object via thecomponent or the lamp inside the vehicle in response that driving of thevehicle is terminated.
 20. The method of claim 12, wherein thecontrolling of the component comprises, based on identification that aplurality of objects which have fallen at an interval shorter than apreset time difference are communication devices capable of making theshort-range wireless communication connection with the component insidethe vehicle, selecting an object having a high priority from among theplurality of objects, based on a preset criterion, and connecting theselected object with the component.